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Abstract. The concept of (A, £?)-invariant subspace (or controlled invariant) 
of a linear dynamical system is extended to linear systems over the max-plus 
semiring. Although this extension presents several difficulties, which are sim- 
ilar to those encountered in the same kind of extension to linear dynamical 
systems over rings, it appears capable of providing solutions to many control 
problems like in the cases of linear systems over fields or rings. Sufficient condi- 
tions are given for computing the maximal (A, £?)-invariant subspace contained 
in a given space and the existence of linear state feedbacks is discussed. An 
application to the study of transportation networks which evolve according to 
a timetable is considered. 



The geometric approach to the theory of linear dynamical systems has provided 
deep insights and elegant solutions to many control problems, such as the distur- 
bance decoupling problem, the block decoupling problem, and the model matching 
problem (see |Won85| and the references therein). The concept of (A, £?)-invariant 
subspace (or controlled invariant subspace, see |BM91j ) has played a significant role 
in the development of this approach. 

It is natural to try to apply the same kind of methods to discrete event systems. 
Several mathematical models have been proposed, see in particular |CLQ95j for a 




survey of the following approaches. Ramadge and Wonham |RW87j initiated the 
logical, language-theoretic approach, in which the precise ordering of the events is of 
interest and time does not play an explicit role. This theory addresses the synthesis 
of controllers in order to satisfy some qualitative specifications on the admissible 
orderings of the events. Another approach is the max-plus algebra based control 
approach initiated by Cohen ct al. |CDQV85 , in which in addition to the ordering, 
the timing of the events plays an essential role. A third approach is the perturbation 
analysis of Cassandras and Ho [CH83| , which deals with stochastic timed discrete 
event systems. 

The max-plus semiring is the set 1U {— 00} , equipped with max as addition and 
the usual sum as multiplication. Linear dynamical systems with coefficients in the 
max-plus semiring turn out to be useful for modeling and analyzing many discrete 
event dynamic systems subject to synchronization constraints (see |BCOQ92p . 
Among these, we can mention some manufacturing systems (Cohen et al. [CDQV85|), 
computer networks (Le Boudec and Thiran |LT01| ) and transportation networks 
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(Olsder et al. |OSG98j . Braker |Bra911 lBra93] . and de Vries et al. |dDD98| ). Many 
results from linear system theory have been extended to systems with coefficients in 
the max-plus semiring, such as the connection between spectral theory and stabil- 
ity questions (see [CMQV89|) or transfer series methods (see |BCOQ92p . Several 
interesting control problems have also been studied by, for example, Boimond et 
al. [BCFH991 IBFHMOO] . Cottenceau et al. |CHMSM03j and Lhommeau |Lho03| . 
In contrast to the approach presented here, which is based on state space represen- 
tation, their approach uses transfer series and residuation methods and therefore 
deals with different types of specifications. 

This motivates the attempt to extend the geometric approach, and in particular 
the concept of (A, i?)-invariant subspace, to the theory of linear dynamical systems 
over the max-plus semiring, a question which is raised in |CGQ99| . The same 
kind of generalization, which was initiated by Hautus, Conte and Pcrdon, has been 
widely studied for linear dynamical systems over rings (see |Hau82| IHau84l ICP94| 
ICP95 , Ass99, ALP99p . In this paper we will see that the extension of the geometric 
approach to linear systems over the max-plus semiring presents similar difficulties 
to those encountered in dealing with coefficients in a ring rather than coefficients in 
a field. The (A, i?)-invariance problem has been studied in the framework of formal 
series over some complete idempotent semirings by Klimann |Kli03j . 

To illustrate one of the possible applications of the results presented in this 
paper, we apply the methods presented here to the study of transportation networks 
which evolve according to a timetable. Max-plus linear models for transportation 
networks have been studied by several authors, see for example |OSG98( IBra91( 
IBra93| ldDD98j . Let us consider the simple railway network given in Figure [IJ 
which has been borrowed from dDD98 . In this network, we assume that in the 
initial state there is a train running along each of the tracks which connect the 
following stations: P with Q, Q with P, Q with Q via R and finally Q with Q via 
S. In Figure [TJ these tracks are denoted by d\, d,2, d^ and d^ respectively. The 
traveling time on track di is given by U, for i = 1, . . . ,4. We will assume that the 
following conditions are satisfied. A first condition is that at station Q the trains 
coming from stations P and S have to ensure a connection to the train which leaves 
for destination R and vice versa. The second condition is that a train cannot leave 
before its scheduled departure time which is given by a timetable. If we assume 
that a train leaves as soon as all the previous conditions have been satisfied, then 
the evolution of the transportation network can be described by a max-plus linear 
dynamical system where the scheduled departure times can be seen as controls (see 
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Section [5]). We will see that the tools presented in this paper can be used to analyze 
this kind of network. For example, it is possible to determine whether there exists 
a timetable that satisfies such conditions as the following. A first condition could 
be that the time between two consecutive departures of trains in the same direction 
be less than a certain given bound. As a second condition we could require that the 
time that passengers have to wait to make some connections be less than another 
given bound. Of course, more general specifications could be analyzed. We show 
how to compute a timetable which satisfies these requirements when it exists. For 
instance, suppose that in the railway network given in Figure Q] we want the time 
between two consecutive departures of trains in the same direction to be less than 
15 time units and the maximal time that passengers have to wait to make any 
connection to be less than 4 time units. In Section [5] we show that this is possible 
and give a timetable which satisfies these requirements. 

This paper is organized as follows. In Section [5J after a short introduction 
to max-plus type semirings, we introduce the concept of geometrically (A, B)- 
invariant scmimodulc and generalize the Wonham fixed point algorithm (which is 
used to compute the maximal (A, i?)-invariant subspace contained in a given space, 
see |Won85j ) to max-plus algebra. In Section [3] we introduce the concept of volume 
of a semimodule and study its properties. In Section 3] we use volume arguments 
to show that the fixed point algorithm introduced in Section [2] converges in a finite 
number of steps for an important class of semimodules. In Section[5]we consider the 
concept of algebraically (A, _B)-invariant semimodule and give a method to decide 
whether a finitely generated semimodule is algebraically (A, i?)-invariant. Finally, 
in Section[S]we apply the methods given in this paper to the study of transportation 
networks which evolve according to a timetable. 

Let us finally mention that some of the results presented here were announced 
in [GK03| and considered in [Kat03| . 

Acknowledgment. The author would like to thank S. Gaubert for many helpful 
suggestions and comments on preliminary versions of this manuscript and J.- J. 
Loiscau for useful references. He would also like to thank J. E. Cury and the 
anonymous reviewers who helped to improve this paper. 

2. Geometrically (A, ^-invariant semimodules 

Let us first recall some definitions and results. A monoid is a set equipped with 
an associative internal composition law which has a (two sided) neutral element. A 
semiring is a set S equipped with two internal composition laws © and (g>, called 
addition and multiplication respectively, such that S is a commutative monoid for 
addition, S is a monoid for multiplication, multiplication distributes over addition, 
and the neutral element for addition is absorbing for multiplication. We will some- 
times denote by (<S, ffi, ©, e, e) the semiring 5, where e and e represent the neutral 
elements for addition and for multiplication respectively. We say that a semiring S is 
idempotent \ix@x = x for all x 6 S. In this paper, we are mostly interested in some 
variants of the max-plus semiring R ma x, which is the set R U {— oo} equipped with 
ffi = max and ® = + (see |Pin98j for an overview). Some of these variants can be ob- 
tained by noting that a semiring M max , whose set of elements is MU{— oo} and laws 
are © = max and © = +, is associated with a submonoid [M, +) of (R, +). Sym- 
metrically, we can consider the semiring M m [ n with the set of elements M U {+00} 
and laws © = min and © = +. For instance, taking M = Z we get the semiring 
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Z max = (Z U {— cx)}, max, +), which is the main semiring wc arc going to work 
with, and taking M — N wc get the semiring N m i n = (NU {+00}, min, +), which is 
known as the tropical semiring (sec |Pin98j). Recall that an idempotent semiring 
(5, ©, ®) is equipped with the natural order, x < y -<=>• x © y = y (sec for exam- 
ple |BCOQ92j ). Sometimes it is useful to add a maximal element for the natural 
order to the semirings M max and M m j n , obtaining in this way the complete semirings 
M max = (MU{±oo}, max, +) and M m i n = (MU{±oo}, min, +), respectively. Note 
that, in the semirings M max and M m ; n , the value of (—00) + (+00) = (+00) + (—00) 
is determined by the fact that the neutral clement for addition is absorbing for mul- 
tiplication. Then, we know that (—00) + (+00) = (+00) + (—00) = —00 in M max 
and (—00) + (+00) = (+00) + (—00) = +00 in A/ m ; n . 

Wc next introduce the concept of scmimodules which is the analogous over semir- 
ings of vector spaces (we refer the reader to G K95j and |Gau98j for more details 
on semimodules) . A (left) semimodule over a semiring (<S, ffi, <g>, £5, e) is a commu- 
tative monoid (X, ©), with neutral element ex, equipped with a map S x X — > X, 
(A, x) — > A • x (left action), which satisfies: 

(A ® n) ■ x = A • (/U • x) , 
\-{x@y) = \-x®\-y, 
(\®fi)'X = X- x®fj,-x, 
£s -x = e x , 
A ■ ex = £x , 

for all x,y £ X and A,/i 6 S. We will usually use concatenation to denote both 
the multiplication of iS and the left action, and we will denote by e both the zero 
element es of S and the zero element ex of X. A subsemimodule of X is a subset 
Z C X such that \x®\iy £ Z, for all x,y £ Z and A, fi G S. In this paper, we 
will mostly consider subsemimodules of the free semimodule S n , which is the set 
of n-dimensional vectors over S, equipped with the internal law (x(By)i = x% ffi yi 
and the left action (A • x)i = A ® x,. If G C X, we will denote by spanG the 
subsemimodule of X generated by G, that is, the set of all x £ X for which there 
exists a finite number of elements u\, . . . ,Uk of G and a finite number of scalars 
Ai, . . • , Afe £ 5, such that £ = © i=1 fcAjiij. Finally, if G £ l S™ xr , we will denote 
by Im G the subsemimodule of <S n generated by the columns of G. 

Let (iS, ©, <g>) denote a semiring. By a system with coefficients in or a system 
over S, we mean a linear dynamical system whose evolution is determined by a set 
of equations of the form 

(1) x(k) = Ax(k - 1) © Bu(k) , 

where A £ S nxn , B £ S nxq , and x(k) £ 5" xl , u(fc) £ S qxl , k = 1,2,... are the 
sequences of state and control vectors respectively. 

We are interested in studying the following problem: Given a certain specification 
for the state space of system ([T]), which we suppose is given by a semimodule 
K, £ <S™, we want to compute the maximal set of initial states /C* for which there 
exists a sequence of control vectors which makes the state of system ([1]) stay in 
K, forever, that is, such that x(k) £ K, for all k > 0. To treat this problem it is 
convenient to make the following definition. 
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Definition 1. Given the matrices A G g nxn an d B ^ S nxq , we say that a semi- 
module X C S n is (geometrically) {A, i?)-invariant if for all x G X there exists 
u G S q such that Ax © Bu belongs to X . 

The proof of the following lemma is identical to the case of linear dynamical 
systems over rings. We include it for completeness. 

Lemma 1. If JC C S n is a semimodule, then JC* is the maximal (geometrically) 
{A, B) -invariant semimodule contained in JC. 

Proof. In the first place, note that a semimodule X C S n is (geometrically) (A, B)- 
invariant if and only if for each x G X there exists a sequence of control vectors 
such that the trajectory of the dynamical system (Q]), associated with this control se- 
quence and the initial condition x(0) = x, is completely contained in X. Therefore, 
any (geometrically) (A, i?)-invariant semimodule contained in IC is also contained 
in JC*. In the second place, note that JC* is a subsemimodule of S n since system ([T]) 
is linear and IC is a semimodule. Then, to prove the lemma, it only remains to show 
that IC* is (geometrically) (A, i?)-invariant. Let x be an arbitrary element of JC*. 
We must see that there is a control it(l) G S q such that x(l) = Ax © Bu(l) belongs 
to IC* . Since x G JC* , we know that there exists a sequence of control vectors it(/c), 
= 1,2,..., such that the trajectory x(0), x(l), x(2), ... of system ([1]), associated 
with this control sequence and the initial condition x(0) = x, is completely con- 
tained in IC. Therefore, x(l) G JC* since there exists a sequence of control vectors 
(u'(k) = u(k + 1), k = 1,2,.. .) which makes the state of system ([l} stay in JC 
forever when the initial state is x(l). □ 

To tackle the previous problem in the case of max-plus type semirings, we gen- 
eralize the classical fixed point algorithm which is used to compute the maximal 
(A, £?)-invariant subspacc contained in a given space (see |Won85j ). With this 
purpose in mind, we set B = ImB and consider the self-map <p of the set of sub- 
semimodules of <S n , given by: 

(2) ip{x) = xnA~ 1 (xeB) , 

where A^ 1 (y) = {u G S n Au G y} and Z Q y = {u G S n \ 3y ey,u®y G 2} 
for all Z,y C S n . 

Remark 1. Note that when S = Z max or S = N m in, if the semimodule X is finitely 
generated, then the semimodule f{X ) is also finitely generated. In fact, given the 
sets of generators of some finitely generated semimodules Z and y, the semimod- 
ules y 9 Z, A~ x (y) and yp\Z can be expressed as the images by suitable matrices 
of the sets of solutions of appropriate max-plus linear systems of the form Dx = Cx 
(see }Gau98| for details). Therefore, their sets of generators can be explicitly com- 
puted using a general elimination algorithm due to Butkovic and Hegediis [BH84] 
and Gaubcrt [Gau92| . Then, when X is finitely generated, the set of generators of 
<p(X) can also be computed using this algorithm. More generally, if X belongs to 
the class of rational semimodules (this class, which extends the notion of finitely 
generated semimodule, turns out to be useful in the geometric approach to discrete 
event systems, see [GK04|), then (p(X) is also a rational semimodule and can be 
computed by Theorem 3.5 of |GK04] . 

Lemma 2. A semimodule X C S n is (geometrically) (A, B) -invariant if and only 
ifX = <p(X). 
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Proof. Since 

A~ 1 {XQB) = {x G S n | Ax G X e B} = 

= {xe S n | 3b G S, Ax © 6 g A"} = 

= {.x G 5" | 3u G S q ,Ax ®BueX} , 

we see that A~ X {X £>) is the set of initial states x(0) of the dynamical system ([I]) 
for which there exists a control which makes the new state of the system, that 
is x(l) = Ax(Q) © Bu(l), belong to X. Then, it readily follows from Definition [1] 
that a semimodulc X C S n is (geometrically) (A, £?)-invariant if and only if X C 
i'^A'QB). Therefore, a semimodulc X C 5™ is (geometrically) (A, £?)-invariant 
if and only if .Y = <y2(<-f), that is, (geometrically) (A, _B)-invariant semimodulcs arc 
precisely the fixed points of the map p defined by ((2]) . □ 

Inspired by the algorithm in the classical case, we define the following sequence 
of semimodules: 

(3) Xx = K , X r+1 = cp(X r ) , Vr G N. 

Then we have the following lemma. 

Lemma 3. Let K, C S n be an arbitrary semimodule. Then the sequence of semi- 
modules {X r } r £tq defined by ([3]) is decreasing, i.e. X r+ \ C X r for all r G N. 
Moreover, if we define X w = n,-eNX r , then every (geometrically) (A, B) -invariant 
semimodule contained in K, is also contained in X w . In particular, it follows that 
K* c X u . 

Proof. The fact that the sequence of semimodules {A^jrgN is decreasing is a con- 
sequence of the definition of the map if. 

x r+l = ip(x r ) = x r n A~\x r es)c x r , 

for all r G N. 

To prove the second part of Lemma [3l firstly it is convenient to notice that (p 
satisfies the following property: 

vz,ycs n , zcy^ tp(z) c <p(y) , 

that is, tp is monotonic when the set of subsemimodules of S n is equipped with the 
order: Z < y if and only if Z C y. 

Now let X C K. be an arbitrary (geometrically) (A, B)-invariant semimodule. 
We will prove by induction on r that X C X r for all r 6 N, and therefore that 
X C DrenXr = X u . In the first place, we know that X C K = X\. Since A 1 is a 
(geometrically) (A, £?)-invariant semimodule, thanks to Lemma El it follows that 
X = p(X). If we now assume that X C Xt, then we have: 

X = p(X) C p(X t ) - X t+1 . 

Therefore, X C X r for all r G N, as we wanted to show. □ 

Note that if the sequence {X r } rG jq stabilize^, that is, if there exists k £ N such 
that Xk + i = Xk, then our problem will be solved. Indeed, if there exists k G N 
such that X^ = X^ + i = p(Xi t ) then, thanks to Lemma [21 we know that Xf, is a 
(geometrically) (A, i?)-invariant semimodule which is contained in K, (since X\ = K, 



Throughout this paper, we will use the word "stabilize" to mean "converge in a finite number 
of steps" . 
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and by Lemma [3] the sequence {X r } rl zfq is decreasing). Therefore Xk C JC* , and as 
by Lemma [3] we know that r C 4, it follows finally that JC* = Xk- 



Example 1. Let S = Z max . Let us consider the matrices 

. /-co \ D {0 

A = [ n and B 



-co/ ^0 

and the scmimodule JC = {(x,y) T G Z^ ax | y > x + 1}. Let us compute, in this 
particular case, the sequence of semimodules {X r } r ^jq defined by ((3J. By definition 
we know that X\ = JC = {(x, y) T G Z^ ax | y > x + 1}. Since there exists A G Z max 
such that max(y, A) > max(x, A) + 1 (that is, there exists (A, A) T G B such that 
(x,y) T © (A, A) T G X{) if and only if y > x + 1 (that is, (x,y) T G Xi), we get 
X x 96= Xi. Therefore, 

A~ X {X\ 9 E) = A^ 1 (Xi) 

= {(x,y) T GZL x I A( Xl y) T e X,} 

= {(x,y) T GZL X | (^xfGA-J 

= {{x,y) T eZ 2 max \ x>y + l} , 

and thus 

^ 2 = x 1 nA- 1 {x l eB) 

= {(x,j,) T ezLl y>x + i}n{(x,2/) T GZLxl ^>y + i} 

= {(-00) -°°) T } ■ 

Then, since by Lemma[3]the sequence of semimodules {AV} r gN is decreasing, it fol- 
lows that Xk = {(— oo, — co) T } for all k > 2. Therefore, the maximal (geometrically) 
(A, i?)-invariant semimodulc contained in JC is trivial: JC* = X^ = {(-co, — co) T }. 

In the case of the theory of linear dynamical systems over a field, the sequence 
{X r } r £tq always converges in at most n steps, since it is a decreasing sequence of 
subspaces of a vector space of dimension n. However, one of the problems in the 
max-plus case, which is reminiscent of difficulties of the theory of linear dynamical 
systems over rings (see |Ass99[ IALP991 ICP941 ICP951 IHau82[ IHau84j ). is that the 
sequence {AVjrgN may not stabilize (see Example [2] below). This difficulty comes 
from the fact that the semimodule Z" ax is not Artinian, that is, there are infinite 
decreasing sequences of subsemimodules of 2^ ax . In the case of linear dynamical 
systems over rings, the convergence of the sequence {X r } re jq in a finite number of 
steps is not guaranteed cither, and although there exists a procedure for finding JC* 
when S is a Principal Ideal Domain (see [CP94j ). in general the computation of JC* 
remains a difficult problem. 

Example 2. Let S = Z max . Let us consider the matrices 

a ( -1 -°o\ , „ fO 
A = „ and B = 



co J \0 

and the semimodulc JC — {(x,y) T G 2^ nax | y < x — 1}. Note that JC = ImK, 
where 

K=(\ ° 

\ —1 -co , 



Next we show that in this case the sequence of semimodules {X r }reN defined by ^ 
is given by: 



(4) X r = {(x, y) 1 G K ax \y<x-r}= Im 





— r — oo 



for all r G N. We prove ([!]) by induction on r. Let us note, in the first place, 
that Q is satisfied by definition when r = 1. Assume now that ^ holds for r = k, 
that is: 

X k = {(x, y) T G Z 2 max | y < x - fc} = Im f _^ 

Let us note that Xk B = Xk, since there exists A G Z max such that max(y, A) < 
max(x, A) — k (that is, there exists (A, A) T G B such that (x, y) T © (A, A) T G Afc) if 
and only if y < x — k (that is, (x, y) T G Xk). Therefore, 

A-\x k eB) = A-\Xk) 

= {{x,y) T G Z^ lax | A(x,y) T G X k } 

= {(x,y) T eZ 2 max | ( x -l,yf eX k } 

= {(x, y) T G Z„ lax | y <x — l — k} , 

and thus 

* fe+ i = XkDA-^XkQB) 

= {(x,yf GZLJ y<x-/c}n{(x,2/) T GZL x | y < a! - 1 - k} 

= {(x,y) T G Z^ iax | y<x-(l + fc)}, 

which shows that ([4]) holds for all r G N. 

We see in this way that the sequence of semimodules {X r } r ^jq is strictly de- 
creasing and therefore does not stabilize. Let us finally note that the scmimodulc 
X u = P\ r £f$X r — {(x,y) T G 2^ ax | y = — oo} is A-invariant, that is, A(X UJ ) C X u . 
Then, X u is in particular (geometrically) (A, i?)-invariant and therefore K* = X^ = 
{(x,y) T GZ2 nax I 2/=-oo}. 

An open problem is to determine whether it is always the case that K* — X u . 
It is worth mentioning that this equality does not necessarily hold in the case of 
linear dynamical systems over rings. 

Remark 2. Even when S is a Principal Ideal Domain, it could be necessary to 
compute more than once (but a finite number of times) the limit X u of sequences 
defined as in (|3|). To be more precise, in such a case X\ is defined as /C in the first 
step and, if it is necessary (that is, when X u is not a geometrically (A, _B)-invariant 
module), in the next steps X\ is defined as the smallest closed submodule containing 
the previous limit X w (see |CP94j for details). 

Sufficient conditions for the stabilization of the sequence {X r } re iq defined by (|3j). 
and therefore for the equality K.* = X^ to hold true, will be given in Section [?] in 
the case S = Z max . Note that Example [5] shows that even in the case of the tropical 
semiring N m ; n the sequence of semimodules {X r } re jq may not stabilize (indeed all 
the computations in Example [2] are valid when we restrict ourselves to the semiring 
N~ ax = (N~ U{— oo}, max, +), which is clearly isomorphic to N m i n ). However, more 
general sufficient conditions for the equality JC* = X w to hold true can be given in 



the case of the tropical semiring using compactness arguments. With this aim, let 
us consider the topology of N m i n defined by the metric: 

d(x, y) = | exp(-x) - exp(-y) | , 

for all x,y £ N m i n - Note that N m i n is compact equipped with this topology and 
therefore in is also compact equipped with the product topology. As a matter 
of fact, given a sequence {a; r } r6 N of elements of N m - ln , if the value +00 appears in 
{x r } r6 N an infinite number of times or if the set of finite values (that is, in N) of 
{x r } re N is unbounded (in the usual sense), then +00 is an accumulation point of 
{x r } re N. Otherwise, some finite element Xk of {x r } r6 N must appear in this sequence 
an infinite number of times and then Xk is an accumulation point of {av} re N. Now 
we have the following lemma. 

Lemma 4. Finitely generated subsemimodules of N™ in are compact. 

Proof. Firstly, let us notice that N m i n is a topological semiring, that is, for all 
sequences {avjreN and {y r }reN of elements of N m - ln the following equalities are 
satisfied: 

lim (x r © y r ) = ( lim x r )®[ lim y r ) , 

and 

lim (x r £g> y r ) = ( lim x r J <g> ( lim y r ) . 

Let us now see that a finitely generated semimodule X C N™ in is compact. Indeed, 
since X is finitely generated there exists a matrix Q £ N™£f , for some p £ N, such 
that X = ImQ. Let {Qy r } r eN be an arbitrary sequence of elements of X. To prove 
that X is compact, we must show that {Qy r }ren has a subsequence which converges 
to an element of X. Since N^ in is compact, we know that there exists a subsequence 
{2/r fc }feeN of {y r } r <EN and an element y £ N^ in such that lim^oo y Tk = y. Then, 
using the fact that N m i n is a topological semiring, it follows that 



lim {Qyr k ) = Q lim y Th = Qy £ X . 

k — 'oo \k — *oo / 

Therefore, X is compact. □ 

The following theorem shows that in the case of N m i n the equality JC* = X u 
holds when K. is finitely generated. 

Theorem 1. Let K, C N" lin be a finitely generated semimodule. Then, for all 
matrices A £ N™^ 1 and B £ N™^ n 9 , the maximal (geometrically) (A, B) -invariant 
semimodule JC* contained in fC is given by X u = n ri zfiX r , where the sequence of 
semimodules {X r } rl =j>s is defined by (|3|). 

Proof. By Lemmas [T] and [3l to prove the theorem, it suffices to show that X^ is a 
(geometrically) (^4, _B)-invariant semimodule, which is equivalent to showing that 
X^ = ip{X^) by Lemma [2] 

Since X^ C X r for all r £ N, it follows that tp(XJ) C <f(X r ) = X r+1 for all r £ N. 
Therefore, ip(Xj) C n re nX r = X u . 

Let us now see that X u C <p(Xj). Let x be an arbitrary element of X^. Then, 
since x £ tp(X r ) = X r+ \ for all r £ N, we know that there exists a sequence 
{forlrgN C B such that Ax © b r belongs to X r for all r £ N. As 6 is compact 
by Lemma SJ there exists b £ B and a subsequence {6 rfc }feeN of {6r}rgN such that 
lim/c^oo b r - k — b. Now, since by Lemma |3] the sequence of semimodules {A , r } r eN is 
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decreasing, it follows that Ax © b r , G X Tk for all j > k. Therefore, Ax © b G X Tk 
for all k G N (recall that the semimodulcs X r arc all finitely generated and then, 
by Lemma 01 in particular closed). Then, Ax © b belongs to X u , from which we see 
that x G tp(Xu). Therefore, X u C tp(X u ). □ 

3. Volume 

In the next section we will give sufficient conditions on the semimodule K,, when 
S = Z max , to assure that the sequence of semimodules {X r } r ^ defined by ([3]) 
stabilizes. For this purpose it is convenient to introduce first the notion of volume 
of a subscmimodulc of Z™ ax and study its properties. 

Definition 2. Let K. C Z™ ax be a semimodule. We call the volume of K., repre- 
sented by vol(/C), the cardinality of the set {x G K, \ x% © • • • © x n = 0}, that is, 
vol (K.) = card ({x G /C | xi © • • • © x n = 0}). Also, if K G ZJJ^, we represent by 
vol (X) i/ie volume of the semimodule 1C = Imif, that is, vol (K) = vol (Im A'). 

Before stating the following results, which provide some properties of the volume, 
it is convenient to introduce the following notation: if X C Z^ lax , then we define 
X = {x G X | xi © • • • © x n = 0}. 

Remark 3. Let us consider the max-plus parallelism relation ~ on Z^ l lax defined by: 
x ~ y if and only if x = Ay for some A G R (that is, Xi = X + yi for all 1 < i < n, in 
the usual algebra). We denote by K/ ~ the quotient of a semimodule /C C Z™ ax by 
this relation and by [x] the equivalence class of x G Z" ax . Then, since the function 
f i t — ► (/C/ ~) — [e] defined by /(x) = [x] is a bijection, it follows that the volume 
of K, is equal to card (/C/ ~) — 1, that is, the cardinality of the set of nontrivial lines 
(i.e. the equivalence classes of nonzero elements) contained in K.. The max-plus 
projective space is the quotient of by the parallelism relation. 

Lemma 5. Let A G Z^ x a ™, B G Z™^ and C G Zf n x ax be matrices and Z,y C Z™ ax 
fee semimodules. Then we have: 

(1) y cZ^volCV) < vol(Z) , 

(2) vol (y) < oo, taen 3> £ Z vol (y) < vol (Z) , 

(3) vol (Ay) < vol (A) and then vol (AS) < vol (A) , 

(4) vol (>0>) < vol (y) and i/ien vol (AS) < vol (B) , 

(5) vol (ABC) < vol (£?) , 

(6) if P G Z™*™ and Q G Z^ are invertiblB, then vol (PBQ) = vol (£?) , 

(7) vol (A) = vol(A T ) . 

Proof. [T] This property is a consequence of the definition of volume: y C Z => 
kf^ card (3>) < card (Z) => vol (y) < vol (Z). 

[2] In the first place, we will show that the following simple property is satisfied: 
for all semimodules y, Z C Z™ ax , 

(5) y^z^y^z. 

As a matter of fact, assume that y C, Z. Then, there exists x G Z— y. Therefore, we 
know that x ^ (— oo, . . . , — oo) T and we can define the vector x = (xi © ■ • • © x n ) 1 x 

2 A matrix P is invertible if there exists a matrix P -1 such that PP" 1 = P~ 1 P = I, where / 
is the max-plus identity matrix. In the max-plus semiring, this means that the columns of P are 
equal, up to a permutation, to the columns of I multiplied by non-zero scalars. 
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(that is, ii — Xi — maxjxi, . . . ,x n } for all 1 < i < n, in the usual algebra). Now, 
it follows that x e Z — y and thus y $1 Z. This proves property ([5]). 

Now, using property §5§ and the fact that vol(y) < oo, we get: y ^ Z => y £1 
Z => card (y) < card (Z) => vol (y) < vol (Z). 

[31 Since Ay C Imi, applying Statement [I] we have: vol (Ay) < vol(ImA) = 
vol (A). 

[U From the definition of the set y it follows that for each y £ y— {(— oo, . . . , — oo) T } 
there exists y G y and A G Z such that y = Xy (it suffices to take A = y\ © • • ■ © y n 
and y = X~ 1 y). Therefore, 

Ay - {(-co, . . . , -co) T } C {XAy \ y G y, A £ Z} , 

and then we get: 

vol (Ay) = card ({x <E Ay \ x\ © • • • © x r = 0}) 
< card ({x = XAy | y G y, A G Z, xi © • • • © x r = 0}) 
< card ({Ay | y e y}) < card (y) = vol (y) . 

El Applying Statements [3] and H we get: vol (ABC) < vol (AB) < vol(B). 

[U From Statement O we obtain: vol(B) = vol {P~ 1 PBQQ- 1 ) < vol (PBQ) < 
vol (5). Therefore, vol (B) = vol (PBQ). 

[7] Let us note, in the first place, that we can define in a completely analogous 
way the volume of a subscmimodule of Z^ in . Then, since the function x — > —a; 
is an isomorphism from Z max to Z m j n , it is clear that vol(-Z) = vol(— Z) for 
every subsemimodule Z C Z™ ax . Let us now consider the matrix A' = — A T 
and the semimodule y = Im(A") C Z^ in . Since y = — Im(A T ), we know that 
vol(A T ) = vol(y). Now, using elements of residuation theory (we refer the reader 
to |BJ72] for an extensive presentation of this theory), it can be shown (see for 
example |BCOQ92] or [CGQ01 ) that the following two properties hold: 

A(A i (Ax)) = Ax , Vx G Z^ ax , and 
A»(A(A»y)) = AS , Vy G Z^ nin , 

where the products by A are performed in Z max and the products by A' are per- 
formed in Z m in- Therefore, the function / : Im(A) i— > Im(A") defined by f(y) = 
A^y is a bijection with inverse g(x) = Ax. Then, the function F from Im (A)/ ~ to 
Im(A")/ ~ defined by F([y\) = [A«y], where [x] denotes the equivalence class of x 
by the parallelism relation ~, is also a bijection. Now, using Remark [3l we obtain: 
vol (A) = card(Im(A)/ ~) - 1 = card (Im (A*)/ ~) - 1 = vol^) = vol(y), and 
then vol (A) = vol (y) = vol (A T ). □ 

4. Specifications with finite volume 

In the next theorem we give a condition on the specification /C, when S = Z max , 
ensuring that the sequence of semimodules defined by ([3]) stabilizes. 

Theorem 2. Let /C C ZJj lax be a semimodule with finite volume. Then, for all 
A G ZJ^ ax and B G Z™ a J, the maximal (geometrically) (A, B)-invariant semimodule 
K* contained in K, is finitely generated. Moreover, if we define the sequence of 
semimodules {AV} r gN by (J3j, then /C* = Xk for some k < vol (/C) + 1. 
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Proof. First of all, let us note that every scmimodulc y C Z" lax with finite volume 
is necessarily finitely generated. Indeed, this property is a consequence of the fact 
that y = span (y). Now, as IC* C K, applying Statement [T] of Lemma[5]it follows 
that vol (K.*) < vol QC) < oo, and then IC* is finitely generated. 

Let us now see that the sequence of semimodulcs {X r } re jq defined by ([3]) must 
stabilize in at most vol (/C) + l steps. Indeed, by Lcmma|3]wc know that the sequence 
of semimodulcs {A? r } re N is decreasing. Then, using Statement [1] of Lemma we 
see that {vol (A" r )} r6 N is a decreasing sequence of nonncgative integers. Therefore, 
there exists k < vol(Xi) + 1 = vol(/C) + 1 such that vol(Xk+i) = vol(A^). Then, 
as Xk+i C Xk C IC by Lemma El wc know that vol(Xk+i) = vol(Affe) < vol(/C) < 
oo (once again, by Statement [T] of Lemma [5|). Finally, applying Statement [2] of 
Lemma[S]to the semimodulcs Xk+\ and Xk, it follows that Xk+\ = Xk, from which 
we conclude that IC* = Xk. □ 

An important particular case of Theorem [2] is the one in which the semimodulc 
IC is generated by a finite number of vectors whose entries arc all finite. In this 
case it is possible to bound the volume of IC by means of the additive version of 
Hilbert's projective metric: for all x £ Z™, define 

\\x\\h — maxjii | 1 < i < n} — min{xi \ 1 < i < n} , 

and for all K 6 Z" xs , define 

A H (K) = max{||iif.i||fl- | 1 < i < s} , 

where K.i denotes the i-th column of the matrix K . Then we have the following 
corollary. 

Corollary 1. Let IC = ImK, where K £ is a matrix whose entries are all 

finite. Then, for all A £ and B G the maximal (geometrically) [A, B)- 

invariant semimodule IC* contained in IC is finitely generated and, if we define the 
sequence of semimodules {X r } r ^ by ([3]), there exists some k < (Ah(K) + 1)™ — 
A H (K) n + 1 such that IC* = X k . 

Proof. By Theorem [21 to prove the corollary, it suffices to show that 

(6) vol (IC) < (A H (K) + 1)" - A H (K) n , 

where the power n is in the usual algebra. 

Since the additive version of Hilbert's projective metric || • \\h satisfies the fol- 
lowing properties: 

\\^x\\h = \\x\\h , 

\\x@y\\ H < Nff©||y||H, 

for all x,y £ Z n and A £ Z, it follows that \\x\\h < Ah(K) for all x € K — 
{(— exo, . . . , — oo) T } and therefore IC is contained in the semimodulc 

y = {x g Z" | HxHh < A H (K)} U {(-co, . . . , -co) T } 

(note that the only vector in K. with at least one entry equal to — oo is (-co, . . . , —oo) T ). 
Then, by Statement [1] of Lemma [5J to prove ^ it suffices to show that vol (y) = 
(Ajj(K) + l) n — A#(A") n . With this aim, we must compute the number of elements 
of the set: 

y = {x e y | x x e • • • © x n = 0} 

= {x£Z n \ \\x\\ H < A H (K),xx®---®x n = 0}, 
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that is, the number of vectors x in Z ra with entries between —Ah(K) and zero (since 
maxi Xi = x\ © ■ • • © x n = and Ah (K) > \\x\\h = maxj Xi — mini %i — — min^ Xi) 
and with at least one entry equal to zero (since max^ Xi = 0) . We know that there 
are (™) Ah(K )™ _r elements in the set y with exactly r entries equal to zero. To 
be more precise, there exist (™) different ways of choosing the r entries which will 
have the value zero, and there exist Ajj(K) n ~ r different ways of assigning values 
to the n — r remaining entries among the Ah(K) possible values. Therefore, the 
number of elements of the set y is: 



r=i 



A H (K) n - r = (A H (K) + 1)" - A H {K) n 



and then vol(X) = (A H (K) + 1)" - A H (K) n . □ 

Note that in the proof of Corollary Q] we showed, in particular, that for each 
matrix K G Z^* x whose entries are all finite, the volume vol (K) is bounded by 
(A H (K) + 1)™ - A H (K) n (this is inequality ©). We next show that this bound is 
tight. Indeed, let us consider the semimodulc 

y = {xeZ n \ \\x\\ H < M} U {(-oo, . . . , -oo) T } , 

where M G N. Note that in the proof of Corollary [1] we proved that y has volume 
(M + 1)" - M" . Now, if we define the matrix K e Z™^ by K l3 = M if i = j and 
Kij = otherwise, it follows that y = Im(i^) and Ah(K) = M. Therefore, there 
exist matrices K G Z™ ^ (whose entries are all finite) which have volume equal to 
(A H (K) + 1)« - A H (K) n . 

Theorem [2] is useful in many practical problems because in such problems the 
specification /C frequently has finite volume. This is often the case when /C models 
certain stability conditions, as for example, "bounded delay" requirements. To be 
more precise, let us assume that system ([T]) is the dater representation of a timed 
event graph (we refer the reader to |BCOQ92] for more details on the modeling 
of timed event graphs). Then, a typical case of semimodule K, which arises in 
applications is: 

(7) K, = {x G Z;\ ax | x % - Xj < d tj ,Vl <i,j < n} , 

where D = (dij) is a matrix with entries in Z U {+oo}. Note that the state vector 
x(k), representing the dates of the firings numbered k, belongs to K, if and only if 
x{k)i — x(k)j < <ijj, for all 1 < i, j < n, which means that the delay between the 
k-th firing of the transition labeled j and the fc-th firing of the transition labeled 
i should not exceed d^. Note also that in practice we usually can assume that D 
only has finite entries, since we can replace +oo by a sufficiently large constant. We 
next show that in such a case, the semimodulc K. defined by ([7]) has finite volume. 
Let us first recall that a directed graph Q(A), called the precedence graph of A, is 
associated with a matrix A = (a.y) G R^a™ • This graph is defined as follows: there 
exists a directed arc of weight aji from node i to node j if and only if a,ji =/= — oo. 
A matrix whose precedence graph is strongly connected is called irreducible. The 
spectral radius p ms , x (A) of A is defined by: 



l<k<n i\....,ik 



Pm&AA) = ff)tr(A k )* = max max 

fc=l 

that is, the maximal circuit mean of G{A) 
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Before stating the following lemma, which shows in particular that the semimod- 
ule ||7J| has finite volume when D only has finite entries, let us note that 

(8) K = {x e Z™ ax I Ex < x} , 

where E = (—D) T . Then we have: 

Lemma 6. If the matrix E is irreducible, then the semimodule K, defined by ([8]) 
has finite volume. Moreover, if E has spectral radius strictly greater than the unit 
(that is, 0), then JC reduces to the null vector. 

Proof. In the first place, let us see that JC = Im (E*) n Z™ ax , where 

oo 

E * = ET = 1 ® E ® E 2 ® ■ ■ ■ 

r=0 

(note that the matrix E* can have entries equal to +oo, so that E* should be 
thought of as a map from Z max to Z max ). Indeed, we have: 

x e K => Ex < x, x <G Z™ ax => 
E r x < x, Vr e N, x e zj; ax =^ E*x < x, x e Z^ lax ^ 
E*x = x, x e Z^ lax ^>ielm (E*) n Z™ ax , 

and 



max 



zeim^nz^ 

x = E*y, for some y G Z max , a; S Z m . 
Ex < E*x = E*E*y = E*y = x, x G Z max =^ieiC. 

When i? has spectral radius less than or equal to the unit, we know that: 

E* =I®E®---®E n - 1 , 

since E r < I ® E © • • • ® E^ 1 for all r > n (see for example Theorem 3.20 
of |BCOQ92] ). Moreover, since E is irreducible, we know that all the entries of E* 
are finite. Indeed, this follows from the fact that JSy, for i ^ j, is the maximal 
weight of all paths of length k running from j to i in the precedence graph of E. 
Then, the proof of Corollary [1] shows that K, has finite volume. 

When E has spectral radius strictly greater than the unit, since E is irreducible, 
all the entries of E* are equal to +oo (once again by the interpretation of the entries 
of the matrix E k in terms of the weight of paths in the precedence graph of E). 
Therefore, the only vector in JC = Im (E*) n Z max is the null vector. □ 

We end this section with an example showing that in Theorem [21 the bound 
vol (fC) + 1 on the number of steps needed to stabilize the sequence of semimodulcs 
{AV-jreN defined by ([3|), cannot be improved. 

Example 3. Let us consider the matrices 

/ 1 -oo\ . „ fO 
A = „ and B 



oo J \0 

and the semimodule K. = {(x, y) T £ Z max | x + l<y<x + l}, where I e N. Then, 
in this case we have: 

ft = {(x, y) T e K | x 8 y = 0} = {(-1, 0) T , . . . , (-1, 0) T } , 
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from which we get vol (JC) = /. Therefore, we arc able to apply Theorem^ In fact, 
JC = IvnK where 



so we are also in a position to apply Corollary [TJ 

By Theorem[2]wc know that the sequence of scmimodules { X r } r ^ defined by ([3]) 
must stabilize in at most vol (JC) + 1 = 1 + 1 steps. Let us check this fact in this 
particular case. In the first place, note that JC C {(x, yf € Z^ ax | x + 1 < y}, 
so that X r C JC C {(x,y) T £ 2^ ax | x + 1 < y} for all r G N. Then, it is easy 
to show (applying a straightforward variant of the computation of X r Q B done in 
Example [2]) that X r B = X r for all r G N. In this way we get: 



X 1 = {(x,yfeZ 2 niax \x + l<y<x + l}, 

x 2 = x 1 nA- 1 (x 1 eB) = x 1 nA~ 1 (x 1 ) 

= {(x,y) T &K^\x + i<y<x + i}r\ 

{(x,yf eZl Lax \x + 2<y<x + l + l} 

= {{x,y) T EZl llx \x + 2<y<x + l}^X 1 , 

Xi = x l - 1 nA- 1 (x l ^ 1 GB) = x l - 1 nA- 1 (x l - 1 ) 

= {(x,y) T eZ 2 max \x + l-l<y<x + l}n 
{ (x, yf € Z 2 max \x + l<y<x + l + l} 

= {(x, yf e Z? nax \ x + l<y<x + l} 

= {(x,y) T e Z^ nax | y = x + 1} g , 

X l+1 = X l nA- 1 (X l GB) = X l nA~ 1 (X l ) 

= {(x, yf G Z^ ax I y = x + 1} n {(x,yf G Z^ ax I V = x + I + l} 

= {(-c^,-co) T } £ X x . 



In this way we see that in this particular case the sequence of semimodules {<f r }reN 
stabilizes in exactly vol (JC) + 1 = 1 + 1 steps. 



This section deals with another fundamental problem in the geometric approach 
to the theory of linear dynamical systems: the computation of a linear feedback. Let 
us once again consider the dynamical system |T]). Let us assume that we already 
know the maximal (geometrically) (A, _B)-invariant scmimodule JC* contained in 
a given scmimodule JC C S n . From a dynamical point of view, this means that 
the trajectories of system ([T]) starting in JC* can be kept inside JC* by a suitable 
choice of the control. Our new problem is to determine whether this control can be 
generated by using a state feedback. In other words, we want to determine whether 




Then, since by Lemma [3] we know that 



{(-oo, -oo) T } C Xi +2 C X [+ i = {(-oo, -oo) T } 



it is clear that Xi + 2 = Xi+\, and therefore 



JC* = X i+ i = {(-oo, -oo) T } . 



5. Algebraically (A, £?)-invariant semimodules 



is 



there exists a linear feedback u(k) = Fx(k — 1). where F G S qxn , which makes K* 
invariant with respect to the resulting closed loop system: 



(9) 



x(k) = (A®BF)x{k - 1) , 



that is, such that every trajectory of the closed loop system §9§ is completely 
contained in /C* when its initial state is in /C* . If a linear feedback with this property 
exists, we will say that /C* is an algebraically (A, _B)-invariant scmimodulc. Some 
authors call this notion (A + Bi^-invariance (see [Ass99j ) or the feedback property 
(see |Hau82[ICP95llCPM] ). 

Definition 3. Given the matrices A G S nXn and B G S nxq , we say that a semi- 
module X c S n is algebraically (A, _B)-invariant if there exists F G S qxn such 
that 



Obviously, every algebraically ( A, i?)-invariant scmimodule is also geometrically 
(A, i?)-invariant. Nevertheless, when S = Z max it is not clear whether a geomet- 
rically (A, i?)-invariant semimodule is algebraically (A, i?)-invariant. Once again, 
this problem is reminiscent of difficulties of the theory of linear dynamical sys- 
tems over rings (see }Hau821 IHau841 ICP941 ICP951 IAss991 IALP99] ). Indeed, in 
the case of linear dynamical systems with coefficients in a field, the class of geo- 
metrically (A, i?)-invariant spaces coincides with the class of algebraically (A, B)- 
invariant spaces (see }Won85j ). This property makes the (geometrically) (A, B)- 
invariant spaces very useful in the classical theory. However, this crucial feature is 
no longer true for linear dynamical systems with coefficients in a ring, that is, there 
exist geometrically (A, £?)-invariant modules which are not algebraically (A, B)- 
invariant (see |Hau82j . in particular Example 2.3). The following example shows 
that this is also the case for linear dynamical systems over the tropical semiring 
N mi „ = (NU {+oo},min,+). 

Remark 4. In the case of rings, a necessary and sufficient condition for K,* to be alge- 
braically (A, i?)-invariant can be given in the form of a factorization condition on the 
transfer function, assuming that the system is reachable and injective (see [Hau82| ) . 
When S is a Principal Ideal Domain, it can be shown that /C* is algebraically (A, B)- 
invariant if and only if it is a direct summand (see |Hau82[ ICP951 ICP94] ) . 

Example 4. Let S = N m i n . Let us consider the matrices 



and the semimodule /C = {(x,y) T G N^ lin | x < y}. 

In the first place, let us compute the maximal geometrically (^4, B)-invariant 
semimodule fC* contained in /C. With this aim, we will compute the sequence of 
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(A®BF)X G X . 




and 




semimodules {X r } r ^ defined by We have: 
Xi = K={(x,y) T 6N^ n |x<y} , 

x 2 = x 1 nA~ 1 (x 1 QB) 

= { (x, y) T G K in \ x<y}n {{x, yf G N? nin | 1 < y} 

x 3 = x 2 nA- 1 (x 2 eB) = 

= {(x,y) T G Nf nin | x < < n {(x,y) T G Nf nin | 1 < y) 

= x 2 . 

Then, we get fC* = X 2 = {(x, y) T G N^ in | x < y, 1 < y}. Indeed, it is easy to check 
that a trajectory which starts at a point of fC* = tC — {(0, 0) T } can be kept inside 
JC with the sequence of controls identically equal to (1, 1) T . and that a trajectory 
which starts at the point (0,0) T cannot be kept inside JC (since for all controls in 
B the next state of the system is always (1,0) T , which does not belong to JC). 

Let us now see that JC* is not an algebraically (A, i?)-invariant semimodule. With 
this aim, we will show that a trajectory which starts at the point (1, 1) T G JC* cannot 
be kept inside fC* when a linear state feedback is applied. Let F G be an 

arbitrary feedback. Then, since F(l, 1) T > 1, we know that BF(1, 1) T = (a, a) T , 
where a > 2. Therefore, 

which shows that IC* is not an algebraically (A, i?)-invariant semimodule. 

We next show how we can decide, using the existing results on max-plus linear 
system of equations, whether a finitely generated subscmimodule of Z™ ax is alge- 
braically (A, i?)-invariant. This method also computes a linear feedback with the 
required property when it exists. Let A G Z™ a ™, B G ZJ^*, and let X be a finitely 
generated subsemimodule of Z™ ax , so that there exists Q G Z™ ax , for some r E N, 
such that X = ImQ. Then, from Definition [3] it readily follows that X is an alge- 
braically (A, £?)-invariant semimodule if and only if there exist matrices F G Z-^™ 
and G e Z^ x ax such that: 

(10) (A © BF)Q = QG . 

As (|10[) is a two sided max-plus linear system of equations, we know that its set of 
solutions (F, G) is a finitely generated max-plus convex set, which can be explicitly 
computed by the general elimination methods (see |BH84( [Gau92|, lGau98| IGP97| ). 
In this way we see that we can effectively decide whether a finitely generated sub- 
semimodule of ZJ^ ax is algebraically (A, B)-invariant. 

Remark 5. The elimination algorithm shows that the set of solutions of a homo- 
geneous max-plus linear system of the form Dx = Cx, where D, C are matrices of 
suitable dimensions, is a finitely generated semimodule. This algorithm relies on 
the fact that hyperplanes of R™ ax (that is, the set of solutions of an equation of the 
form dx = cx, where d, c G are row vectors) are finitely generated. It is worth 

mentioning that the resulting naive algorithm has an a priori doubly exponential 
complexity. However, the doubly exponential bound is pessimistic. It is possible to 
incorporate in this algorithm the elimination of redundant generators which reduces 
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its execution time. In fact, we are currently working on this subject and we believe 
that improvements are possible, since we have shown by direct arguments that the 
number of generators of the set of solutions is at most simply exponential. This 
will be the subject of a further work. 

Let us note that to decide whether X = Im Q is an algebraically (A, £?)-invariant 
semimodule it suffices to know whether the system of equations (fTTJ|) has at least one 
solution. Taking this into account, it is worth mentioning that there are algorithms 
to compute a single solution (with finite entries) of homogeneous max-plus linear 
systems which seem to be more efficient in practice than the elimination methods 
(see }BCG03| IWB98] ). Indeed, it is known that the problem of the existence of 
a solution (with finite entries) of a homogeneous max-plus linear system can be 
reduced to the problem of the existence of a sub-fixed point of a min-max function 
(for more background on min-max functions we refer the reader to [GG981 [CTGG99] 
and the references therein). To be more precise, observe that Dx = Cx is equivalent 
to x < mm {D\Cx,C\Dx}, where D\Cx = sup{y G l" ax I D V < Cx) (C\Dx 
is defined analogously). Since D\Cx can be computed as (—D T )(Cx), where the 
product by — D T is performed in K m i n (sec |BCOQ92 ), it follows that f(x) = 
min {D\Cx, C\Dx} is a min-max function. Then, there is x £ R™ such that x < 
f(x) (that is, a sub-fixed point of /) if and only if all the entries of the cycle 
time vector of /, which is defined as x(f) = l™-fc-»ao f k (x)/k, are nonnegativc 
(see |GG981 ICTGG9 9 The cycle time vector x(/), and, if it exists, a solution 
of x < f(x) can be efficiently computed via the min-max Howard algorithm (we 
refer the reader to GG98 , CTGG99 for a detailed presentation of this algorithm) . 
Although the min-max Howard algorithm behaves remarkably well in practice, its 
complexity is not yet well understood ( |GG98[ [CTGG99] ) . 

To be able to apply this algorithm to solve our problem, firstly we need to add 
one unknown t to system (|10[) in order to obtain a homogeneous max-plus linear 
system of equations: 



Then, as system (|TU)) has at least one solution if and only if system (fTTj) has at 
least one solution with t ^ — oo, the semimodule X = ImQ is algebraically (A, B)- 
invariant if and only if system pip has at least one solution with t — oo (note that 
if (t, F, G) is a solution of (fTT|) with t ^ — oo, then t~ 1 F = {—t)F is the feedback 
we are looking for). Therefore, as (t, F, G) is a solution of (fTT]) if and only if 



where D\C is defined as sup{£ € 2^ | DE < C} for all D G Z£££ and C G Z™*£ 
(the function / is defined in an analogous way), if we can find a sub- fixed point of 
the min-max function defined by the right hand side of (|12[) . then the semimodule 
X = ImQ is algebraically (A, i?)-invariant. 

6. Application to transportation networks with a timetable 

Let us consider the railway network given in Figure [T] Firstly, we will re- 
call how the evolution of this kind of transportation network can be described 
by max-plus linear dynamical systems of the form of |T]) (we refer the reader 



(11) 



(At © BF)Q = QG . 



(12) 



t < (AQ)\(QG) , 
F < B\(QG)/Q, 
G < Q\((At © BF)Q) , 
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to |BCOQ92[ IOSG981 IBra911 ldDD98j for details on max-plus models for trans- 
portation networks). We are interested in the departure times of the trains from 
the stations. Let us assume that in the initial state there is a train running along 
each of the following tracks: the one connecting P with Q, the one connecting Q 
with P, the one connecting Q with Q via R, and finally the one connecting Q with 
Q via S. We call these tracks directions d±, d,2, d^ and d^ respectively, as it is 
shown in Figure [TJ In general, we can have n different directions. The traveling 
time in direction di (to which the time needed for passengers to leave and board 
the train is added) will be denoted by tj. For our example these times are given 
in Figure [T] Let Xi{k) denote the fc-th departure time of the train which leaves 
in direction di. As we explained in the introduction, a train cannot leave before a 
number of conditions have been satisfied. A first condition is that the train must 
have arrived at the station. For instance, let us assume that the train which leaves 
in direction di is the one which comes from direction d r ^ (in Figure [T] we have: 
r(l) = 2, r(2) = 4, r(3) = 3, and r(4) = 1). Then, the following condition must be 
satisfied: 

(13) i r(i ) +av(i)(fc - 1) < Xi(k) . 

A second constraint follows from the demand that trains must connect. This gives 
rise to the following condition 

(14) tj + Xj (k - 1) < Xi(k) , Vj g (7(i) , 

where C(i) is the set of indexes of all the directions of the trains which have to 
provide a connection with the train which leaves in direction di (in the case of the 
network given in Figure Q] we have: (7(1) = 0, (7(2) = {3}, (7(3) = {1,4}, and 
(7(4) = {3}). Finally, the last condition is that a train cannot leave before its 
scheduled departure time. This yields 

(15) u*(*0 > 

where itj(fc) denotes the scheduled departure time for the fc-th train in direction di. 
Now, if we assume that a train leaves as soon as all the previous conditions have 
been satisfied, in max-plus notation conditions (fl"3"]) . (TTJJ and (fT5|) lead to 

(16) Xi(k)= tjXj(k-l)®t r wx r (i)(k-l)®Ui(k) . 

Therefore, if we define the matrix A = (a ?J ) G by: 

tj ifjeC(i)U{r(i)}, 
— oo otherwise, 



then (|16[) can be written in matrix form as 

(17) x(k) = Ax(k - 1) © u(k) , 

where x(k) = (xi(fc), . . . , x n (k)) T and u(k) = (ui(k), . . . , u n (k)) T , which is a sys- 
tem of the form of {T]). I n the particular case of the railway network shown in 
Figure [T] we have 





-oo 


17 


— oo 


— oo^ 




-oo 


— oo 


11 


9 




14 


— oo 


11 
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14 


— oo 


11 


— oo J 
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Suppose now that we want to decide whether there exists a timetable such that 
the time between two consecutive train departures in the same direction is less 
than a certain given bound or such that the time that passengers have to wait to 
make some connections is less than another given bound. To be able to model 
this kind of requirement it is convenient to introduce the extended state vector 
x(k) = (xi(k), . . . , x n (k), X\{k — 1), . . . , x n {k — 1)) T - Then (JTTJ) can be rewritten as 
x(k) = Ax(k - 1) © Bu(k), where 

(here I,e £ Z™*™ denote the max-plus identity and zero matrices, respectively). 
Assume that we want the time between two consecutive train departures in direction 
di to be less than Li time units. This can be expressed as Xi{k) ~Xi +n (k) < Li, or 
equivalcntly as Xi(k) — Li < Xj+ n (fc). For simplicity we will take the same bound L 
for all the directions, although everything that follows can be done with different 
bounds. Then the previous condition can be written in matrix form as 

(18) \^_ £ L)I fjx(k) <x(k) , VfceN. 

Suppose now that we want passengers coming from direction di not to have to wait 
more than Mij time units for the departure of the train which leaves in direction 
dj. This can be expressed as Xj(k) — ciji — Xi+ n (k) < Mij, which is equivalent to 
Xj(k) — aji — Mij < Xi +n (k). Once again, if for simplicity we take the same bound 
M for all the possible connections, the previous condition can be written in matrix 
form as 

(19) {(-M)S *W) < , V* € N , 

where the matrix S = (sij) G Z™^™ is defined by: Sy = — aji if ^ — oo and 
Sij = — oo otherwise. Finally, in order to have realistic initial states for the extended 
state vector, we can consider the obvious physical constraints x(k — 1) < x(k) and 
Ax(k — 1) < x(k), which lead to the following condition: 

(20) ^ 1 ® A j x{k) < x(k) , Vfc e N . 

Therefore, to get the desired behavior of the network, the timetable u(k) should be 
such that the extended state vector satisfies conditions (TTB")) . p9[) and (|2ll|) . that is, 
such that Ex(k) < x(k) for all k £ N, where 



E 



e I® A 

{-M)S®{-L)I e 



For instance, let us take L = 15 and M = 4 in the case of the railway network 
shown in Figure[TJ Then Ex(k) < x(k) is equivalent to x(k) £ ImE* (see the proof 
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of Lemma [5]) , where 



E* = 
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Therefore, our problem is to determine the maximal geometrically (A, i?)-invariant 
scmimodulc contained in K, = ImE*. With this aim we compute the sequence of 
semimodulcs {A^jrgN defined by (|3|) following the method described in Remark [T] 
(which has been implemented with scilab, see |Plu98j ) . Since the entries of E* are 
all finite, from Corollary [1] we know that this sequence must stabilize. In fact, we 
have: X§ = X4 £1 X3 X2 $± Xi = Then, the maximal geometrically (A, B)- 
invariant scmimodulc K,* contained in K, is X4, which is generated by the columns 
of the following matrix 
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Consequently, it is possible to obtain the desired behavior of the network with a 
suitable choice of the timetable u(k) when the initial state belongs to K* . To be able 
to compute these timetables we use the method described at the end of Section O 
to decide whether /C* = /C4 is an algebraically (^4, _B)-invariant scmimodulc (that 
is, we apply the min-max Howard algorithm to find a state feedback). In this way 
we can see that K.* is algebraically (^4, £?)-invariant and one possible state feedback 
is given by 

/14 14 14 13 14 14 14 14\ 
— _ 11 14 11 10 14 14 14 14 

14 14 14 13 14 14 14 14 ' 
\14 14 14 14 14 14 14 14/ 

For instance, let us consider the evolution of the railway network when the initial 
state is x(0) = (17, 15, 18, 19, 4, 0, 4, 5) T e K.* and the control F is applied. In this 
case we obtain the following trajectory x(k) of the system 
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which clearly satisfies the constraints imposed on the network. However, if no 
control is applied, we get the following trajectory starting from the same initial 
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state 
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which does not satisfy the constraints imposed on the network, since for example 
the passengers coming from station S on the third train (which leaves from station 
Q in direction di at time 31) will have to wait 6 time units for the next departure 
of a train in direction c?3 toward station R (which will take place at time 46). 

If we want to obtain the desired behavior of the network with a periodic timetable, 
that is with a timetable u(k) of the form u(k) = X k u, where A £ Z max and u <E ax , 
then what we can do is to see if the matrix A®BF has an eigenvector in /C*. In this 
case it can be shown that x(0) = (17, 14, 17, 18, 3, 0, 3, 4) T G /C* is an eigenvector 
of A © BF corresponding to the eigenvalue A = 14, that is, the following equality 
is satisfied: 

(A © B~F)x{0) = 14x(0) . 



Therefore, the periodic timetable 



i(k) = Fx(k - 1) = 14 (fc ~ 1) Fx(0) = 14 



(fc+i) 



/ 3 \ 


3 

w 



leads to the desired behavior of the network when the initial state is x(0). In 
other words, one train should leave in each direction every 14 time units but the 
k-th departure time of the trains in direction d\ and da, respectively in direction di, 
should be scheduled 3 time units, respectively 4 time units, after the fc-th scheduled 
departure time of the train in direction c?2- 

Let us finally mention that the computations of the examples presented in this 
paper have been checked using the max-plus toolbox of scilab (see |Plu98j ). 



7. Conclusion 

In this paper, the classical concept of (A, i?)-invariant space is extended to linear 
dynamical systems over the max-plus semiring. This extension presents similar 
difficulties to those encountered in dealing with coefficients in a ring rather than 
coefficients in a field. On the one hand, we show that the classical algorithm for the 
computation of the maximal (A, i?)-invariant subspace contained in a given space, 
which is generalized to the max-plus algebra framework, need not converge in a 
finite number of steps. However, sufficient conditions for the convergence of this 
algorithm are given. In particular, it is shown that these conditions are satisfied 
by a class of scmimodules of practical interest. On the other hand, the existence 
(which is not guaranteed) and the computation of linear state feedbacks are also 
discussed in the case of finitely generated semimodulcs. Finally, we show that this 
approach is capable of providing solutions to some control problems by considering 
its application to the study of transportation networks which evolve according to a 
timetable. 
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